"The highlighted tokens are primarily morphemes, syllables, or words related to the Korean language, Korean names, or references to Korea in various languages, as well as some corrupted or non-standard characters. These tokens often appear in multilingual contexts, especially when discussing Korean culture, language, or proper nouns."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.95 | 1.0 | 0.9 | 0.947 | 0.9 | 1.0 | 0.0 | 0.1 |
fuzz | 0.926 | 0.976 | 0.872 | 0.921 | 0.872 | 0.979 | 0.021 | 0.128 |